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Abstract: Hybrid systems, and especially piecewise affine (PWA) systems, are 
often used to model gene regulatory networks. In this paper we elaborate on 
previous work about control problems for this class of models, using also some 
recent results guaranteeing the existence and uniqueness of limit cycles, based 
solely on a discrete abstraction of the system and its interaction structure. Our 
aim is to control the transition graph of the PWA system to obtain an oscilla- 
tory behaviour, which is indeed of primary functional importance in numerous 
biological networks; we show how it is possible to control the appearance or 
disappearance of a unique stable limit cycle by hybrid qualitative action on the 
degradation rates of the PWA system, both by static and dynamic feedback, i.e. 
the adequate coupling of a controlling subnetwork. This is illustrated on two 
classical gene network modules, having the structure of mixed feedback loops. 
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Commande qualitative de solutions periodiques 
de systemes affines par morceaux ; application 
aux reseaux genetiques 

Resume : Les systemes hybrides, en particulier affines par morceaux (APM), 
sont souvent employes comme modeles de reseaux genetiques. Dans ce rapport 
nous approfondissons des travaux anterieurs sur la commande de tels systemes, 
utilisant egalement des resultats recents garantissant l'existence et l'unicite de 
cycles limites, sur la seule base d'une abstraction discrete du systeme et de 
sa structure d'interaction. L'objectif est de controler le graphe de transitions 
d'etats du systeme APM pour obtenir un comportement periodique, ce qui 
est une propriete tres importante de nombreux systemes biologiques. Nous 
montrons comment commander l'apparition ou la suppression d'un cycle limite 
unique, par une action qualitative sur les taux de degradation d'un systeme 
APM, aussi bien par commande statique que dynamique, c'est-a-dire par le 
couplage adequat d'un sous-reseau controleur. Ceci est illustre sur deux re- 
seaux de genes classiques, presentant une structure de boucles de retro-action 
imbriquees. 

Mots-cles : Reseaux genetiques, Commande en feedback, Lineaire par mor- 
ceaux, Solutions periodiques 
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1 Introduction 

Gene regulatory networks often display both robustness and steep, almost switch- 
like, response to transcriptional control. This motivates the use of an approxi- 
mation of these response laws by piecewise affine differential (PWA) equations, 
to build hybrid models of genetic networks. PWA systems are affine in each 
rectangular domain (or box) of the state space. They have been introduced in 
the 1970's by Leon Glass [18] to model genetic networks. It has led to a long 
series of works by different authors, dealing with various aspects of these equa- 
tions, e.g. [H [U [TTJ [TS1 [20]. They have been used also as models of concrete 
biological systems [5]. 

From an hybrid system point of view, the behaviour of PWA systems can be 
described by a transition graph, which is an abstraction (in the hybrid system 
sense) of the continuous system. This transition graph describes the possible 
transition between the boxes. It is also possible to check properties of the 
transition graph by model checking techniques [2]. 

Nowadays, the extraordinary development of biomolecular experimental tech- 
niques makes it possible to design and implement control laws in the cell system. 
The authors have recently developed a mathematical framework for controlling 
gene networks with hybrid controls [13]; these controls are defined on each box. 
It is easy to see that this amounts to change the transition graph to obtain the 
desired one. 

From another point of view, more oriented towards dynamical systems, it 
is also possible to obtain results concerning the limit cycles in PWA systems 
(see [19] and the recent generalisation in [E]). For example, one can show that 
a simple negative loop in dimension greater that two produces a unique stable 
limit cycle. It is clear that biological oscillations play a fundamental role in the 
cell (PZ3). 

Our aim in this paper is to control PWA systems to make a single stable limit 
cycle appear or disappear. To fulfil that goal, after some recalls concerning the 
PWA systems, we use some results enabling to deduce the existence of a single 
stable limit cycle in the state space from a periodic behaviour in a box sequence 
(section [3]), then the results on the control of the transition graph in the space of 
boxes (section [4]) , to obtain our main results illustrated by 2 examples (section 

u. 

Related works on control aspects concern the affine or multi-amne hybrid 
systems ([22j |3|). The authors derive sufficient conditions for driving all the 
solutions out of some box. Other related works study the existence of limit 
cycles in the state space [T9l [25] . We are not aware of works linking control 
theory and limit cycle for this class of hybrid systems. 



2 Piecewise affine models 



2.1 General formulation 

This section contains basic definitions and notations for piecewise affine models 
[HI [HUH! [6]. The general form of these models can be written as: 

^ = k(x) - T(x)x (1) 
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The variables (x\ . . .x n ) represent levels of expression of n interacting genes, 
meaning in general concentrations of the mRNA or protein they code for. We 
will simply call genes the n network elements in the following. Since gene 
transcriptional regulation is often considered to follow a steep sigmoid law, an 
approximation by a step function has been proposed to model the response of a 
gene (i.e. its rate of transcription) to the activity of its regulators [18]. We use 
the notation: 

f s+(x,9) = ]Sx<6, 
\ s+(x,9) = 1 if x > 9, 

This describes an effect of activation, whereas s~(x, 9) = 1 — s + (x, 9) represents 
inhibition. Unless further precision are given, we leave this function undefined 
at its threshold value 9. 

The maps K : K™ — * and T : M" — » K" xn in QJ are usually multivari- 
ate polynomials (in general multi-affine) , applied to step functions of the form 
s ± (xi,9 i ), where for each i 6 {1, • • • , n} the threshold values belong to a finite 
set 

e* = {0°,...,0f}. (2) 

We suppose that the thresholds are ordered (i.e. 9\ < 9j +1 ), and the extreme 
values 9® — and 9f represent the range of values taken by Xi rather than 
thresholds. 

T is a diagonal matrix whose diagonal entries Tu — 7$, are degradation rates of 
variables in the system. Obviously, T and the production rate k are piecewise- 
constant, taking fixed values in the rectangular domains obtained as Cartesian 
products of intervals bounded by values in the threshold sets ((2j) - These rect- 
angles, or boxes, or regular domains |27l [6], are well characterised by integer 
vectors: we will often refer to a box D a = rJiW"" ' @T) by its lower-corner 
index a = (ax — 1 . . .a n — 1). The set of boxes is then isomorphic to 

A = l[{0,--- ,<fe-l}, (3) 
i=i 

Also, the following pairs of functions will be convenient notations: 9f : A — »■ Qi, 
9;{a) = 9?- 1 and 9f (a) = 9?\ 

Let us call singular domains the intersections of closure of boxes with threshold 
hyperplanes, where some Xi £ &i \ {9®, 9f}. On these domains, the right-hand 
side of ([1]) is undefined in general. Although the notion of Filippov solution 
provides a generic solution to this problem [20], in the case where the normal 
of the vector field has the same sign on both side of these singular hyperplanes, 
it is more simply possible to extend the flow by continuity. In the remaining 
of this paper, we will only consider trajectories which do not meet any singular 
domain, a fact holding necessarily in absence of auto-regulation, i.e. when no 
K{ depends on Xi. This leads to the following hypothesis: 

Vi G {1, • • • , n} , Hi and ji do not depend on Xi. (HI) 

On any regular domain of index a S A, the rates k — n(a) and V = T(d) are 
constant, and thus equation |TJ is affine. Its solution is explicitly known, for 
each coordinate i : 

ipi(x,t) = Xi(t) = 4>i(a) + e~ 7lt (xi - 4>i{a)) , (4) 
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where t G R + is such that x(t) € D a , and 

' K\(a) K n (a) 



(a) = (0i (a) ••■(/)„ (a)) 



7i (a) 7n(a) 



It is clearly an attractive equilibrium of the flow iJU). It will be called focal 
point in the following for reasons we explain now. Let us first make the generic 
assumption that no focal point lies on a singular domain: 

VaeA, (j){a) e |J T) a >. (H2) 

a'EA 

Then, if </>(a) 6 D a , it is an asymptotically stable steady state of system (JTJ) . 
Otherwise, the flow will reach the (topological) boundary dT) a in finite time. 
At this point, the value of k (and thus, of 4>) changes, and the flow changes 
its direction, evolving towards a new focal point. The same process carries on 
repeatedly. It follows that the continuous trajectories are entirely characterised 
by their successive intersections with the boundaries of regular domains (ex- 
tending them by continuity, as mentioned previously). 

This sequence depends essentially on the position of focal points with respect 
to thresholds. Actually, {x \ Xi — 0~ (a)} (resp. {x \ Xi — 9^ (a)\) can be 
crossed if and only if 4>i{a) < 9~ (a) (resp. <f)i(a) > 9^ [a)). Then, let us 
denote I+ Ut (a) = {i e {!,■■■ ,n}\<j) l > 6f(a)}, and similarly I~ ut (a) = {i 6 
{1, • • • ,n}\ fa < Oi(a)}. Then, I out (a) = /^(a) U I~ ut (a) is the set of escaping 
directions of D a . Also, we call walls the intersections of threshold hyperplanes 
with the boundary of a regular domain. 

When it is unambiguous, we will omit the dependence on a in the sequel. Now, 
in each direction i G I ou t the time at which x(t) encounters the corresponding 
hyperplane, for x g T) a , is readily calculated: 

Ti(x) = — ln(^£y iel± t . (5) 

7i \<Pi- Xi ) 

Then, t(x) — min. ie / out t;(x), is the exit time oiD a for the trajectory with initial 
condition x. Then, we define a transition map T a : dD a — » dT> a : 

T a x = lp( Xi t{x)) 

= <f> + a(x){x-<fi). {) 

where a(x) — exp(— t(x)T). 

The map above is defined locally, at a domain T> a . However, under our assump- 
tion (HI), any wall can be considered as escaping in one of the two regular 
domains it bounds, and incoming in the other. Hence, on any point of the inte- 
rior of a wall, there is no ambiguity on which a to choose in expression ([6]), and 
there is a well defined global transition map on the union of walls, denoted T. 
On the boundaries of walls, at intersections between several threshold hyper- 
planes, the concept of Filippov solution would be required in general [20]. This 
problem will either be solved on a case by case basis, or we implicitly restrict our 
attention to the (full Lebesgue measure) set of trajectories which never intersect 
more than one threshold hyperplane. 
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To conclude this section let us define the state transition graph TG associated 
to a system of the form (TJJ) as the pair (A, £) of nodes and oriented edges, where 
A is defined in ^ and (a, b) e £ C A 2 if and only if d"D a n dD b ^ 0, and there 
exists a positive Lebesgue measure set of trajectories going from D to D&, It 
is not difficult to see that this is equivalent to b being of the form a ± e$, with 
i G Iov,t( a ) an d e « a standard basis vector. 

From now on, it will always be assumed that (HI) and (H2) hold, at least in 
some region of state space (or transition graph) on which we focus. 



2.2 Illustrative example 

Let us now illustrate the previous notions on a well-known example with two 
variables, in order to help the reader's intuition. Consider two genes repressing 
each other's transcription. In the context of piecewise-affine models, this would 
be described by the system below: 

( xi = k\ + k\s-{x 2 ,0\) - 7iXi 
®^_>2) \ ±2 = 4 + k\s-{ X1i 6\)- 12 x 2 

where inhibition is modeled by s~(a;, 9), as already mentioned. A usual notation 
for the interaction graph uses — I to denote inhibition, and — >■ to denote 
activation. 

The two constants k° represent the lowest level of production rates of the two 
species in interaction. It will be zero in general, but may also be a very low 
positive constant, in some cases where a gene needs to be expressed permanently. 
In the given equation, arbitrary parameters may lead to spurious behaviour, 
in particular an inhibition which would not drop its target variable below its 
threshold. To avoid this, it suffices to assume the following conditions on focal 
points' coordinates: 

K° K° -4- K 1 

^<0j and ^—^>6l fori = 1,2. 

7i % 

This might be called structural constraints on parameters. The phase space of 
this system is schematised on Figure [TJ 



Then, the transition graph of the system takes the form: 



9V<- 


— 11 


t 








00 — 


-Kio 



where circled states are those with no successor. It appears in this case that TG 
constitutes a reliable abstraction of the system's behaviour. In general, things 
are not as convenient, and some paths in the transition graph may be spurious. 
In particular, cyclic paths may correspond to damped oscillations of the original 
system, but even this cannot be always ascertained without a precise knowledge 
of the parameter, see section [3] for related results. However, one general goal of 
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Figure 1: The dashed lines represent threshold hyperplanes, and define a rectan- 
gular partition of state space, and dotted lines indicate focal points' coordinates. 
Arrows represent schematic flow lines, pointed toward these limit points. Note 
that pieces of trajectories are depicted as straight lines, which is the case when 
all degradation rates 7j coincide, a fact we never assume in the present study. 

the present study will be to search for feedback control laws ensuring that given 
systems are indeed well characterised by their abstraction. Such a property 
can be deduced from the shape of the abstraction TG itself, whence the term 
'qualitative control'. 

3 Stability and limit cycles 

Periodic solutions have soon been a prominent topic of study for systems of the 
form J!]) [H [23 [2SIE1 [25]. With the notable exception of [39], all these studies 
focused on the special case where T is a scalar matrix, which greatly simplifies 
the analysis, since trajectories in each box are then straight lines towards the 
focal point, as in Figure [1] In a recent work [TJJ Q21 Q3] , we have shown that the 
local monotonicity properties of transition maps can be used to prove existence 
and uniqueness of limit cycles in systems like |(TJ. In this section we recall 
without proof some of these results. 

In the rest of this section we consider a piecewise-affine system such that there 
exists a sequence C = {a . . . a^ -1 } of regular domains which is a cycle in the 
transition graph, and study periodic solutions in this sequence. We abbreviate 
the focal points of these boxes as (jj 1 = <j)(a l ). Let us now define a property of 
these focal points: we say that the points <j> 1 are aligned if 

Vie{0,.-.,*-l},3ye{l,...,n}, 0} +1 -0}^O, (7) 

where 4> l and <jP are identified. 

Since e is supposed to be a cycle in TG, for each pair (a\a l+1 ) of successive 
boxes there must be at least one coordinate at which their focal points differ, 
namely the only Sj £ I ut{<i l ) such that a l+l = a' 1 ± e s< . We keep on denoting Si 
this switching coordinate in the following. Hence condition (7]) means that Si is 
the only coordinate in which (j> 1 and 4> l+1 differ. This implies in particular that 
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a l+1 is the only successor of a\ i.e. there is no edge in TG from C to A \ 6. It 
might seem intuitive in this case that all orbits in C converge either to a unique 
limit cycle, or to a point at the intersection of all crossed thresholds. However, 
this fact has only been proved for uniform decay rates (i.e. T scalar), [19], and 
its validity with distinct decay remains an open question. 

The condition J7|) is of purely geometric nature. However, it can be shown that 
it holds necessarily when the interaction graph has degree one or less, see [2] 
for more details. 

If {si}o^i<i = {I)"" > n }, i- e - all variables are switching along C, then the 
intersection of all walls between boxes in C is either a single point, which we 
denote 8 e , or it is empty. The latter holds when two distinct thresholds are 
crossed in at least one direction. When defined, 8 e is a fixed point for any 
continuous extension of the flow in 6, see [Ti] , 
Let us now rephrase the main result from [14] . 

Theorem 1. Let G = {a , a 1 ■ ■ ■ a i ~ 1 } denote a sequence of regular domains 
which is periodically visited by the flow, and whose focal points satisfy condition 
(T_2p. Suppose also that all variables are switching at least once. 
Let W denote the wall dD a o C\dD a i , and consider the first return map T : W — > 
W defined as the composite of local transition maps along C. 

A) If a single threshold is crossed in each direction, let A = p(DT(9 e )), the 
spectral radius of the differential DT (6 e ) . Then, the following alternative holds: 

i) if A ^ 1, then Vie £ W, T n x -> 6 e when n^oo. 

ii) if X > 1 then there exists a unique fixed point different from 9 e , say q = Tq. 
Moreover, for every x € W \ {0 e }, T n x — > q as n — > oo. 

B) If there are two distinct crossed thresholds in at least one direction, then the 
conclusion of ii) holds. 

In |12l [T5] we have resolved the alternative above for a particular class of 
systems: 

Theorem 2. Consider a negative feedback loop system of the form 

ii = k° + s £i (x i -i,6 i - 1 ) -jiXi, £,£{-,+} ie{l,-",n}, 

with subscripts understood modulo n, and an odd number of negative e\. It can 
be shown that there exists a cycle C in TG whose focal points satisfy 
Then, in Theorem^ AX) holds in dimension n = 2, and A.ii) holds for all 
n ^ 3. 

4 Piecewise Control 

Feedback regulation is naturally present in many biological systems, as the 
widespread appelation 'regulatory network' suggests. Hence, it seems appro- 
priate to take advantage of the important body of work developed in feedback 
control theory for decades, in order to study gene regulatory networks and re- 
lated systems [231130] . 

In particular, the recent advent of so called synthetic biology [Ij [24] , has led 
to a situation where gene regulatory processes are not only studied, but de- 
signed to perform certain functions. Hence, autonomous systems of the form 
([1]) should to be extended, so as to include possible input variables. In [15] . 
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we have presented such an extension, where both production and decay terms 
have some additional argument u <E R p , of which they were affine functions. In 
this context, we defined a class of qualitative control problems, and showed that 
were equivalent to some linear programming problems. 

As in our previous work, we consider qualitative feedback laws, in the sense that 
they depend only on the box containing the state vector, rather than its exact 
value. This choice is motivated by robustness purposes. More pragmatically, it 
is also due to the fact that recent techniques allow for the observation of qual- 
itative characteristics of biological systems, for instance by live imaging, using 
confocal microscopy, of GFP marker lines, where the measured state is closer to 
an ON/OFF signal than to a real number. 

Recent experimental techniques allow furthermore for the reversible induction 
of specific genes at a chosen instant, for instance using promoters inducible by 
ethanol [7], or light [28], to name only two. Also, degradation rates may be 
modified, either directly by introducing a drug [31], or via a designed genetic 
circuit [21], which might be induced using previously mentioned techniques. 

To simplify the presentation, we focus in this paper on the particular case 
where decay rates can be linearly controlled by a scalar and bounded input u. 
For each i e {1, • • • , n}, let us denote this as: 

^ = Ki{x) - ( 7 /(a;)u + t?(x))x, u e [0, U] C R+, (8) 

where 7° and 7 * are piecewise constant functions assumed to satisfy 7° > and 

7j > — -jf , in any box. This ensures that decay rates are positive, but yet can 
be decreasing functions of u (for < 0). 

Now, a feedback law depending only on the qualitative state of the system is 
simply a expressed as the composite of a map \J a D a — ► A indicating the box 
of the current state, with a function u : A — > [0, U] which represents the control 
law itself. In other words, in each box a constant input value is chosen. For a 
fixed law of this form, it is clear that the dynamics of J8|) is entirely determined, 
and in particular we denote its transition graph by TG(w). 
Let us now recall our definition of control problem. 

Global Control Problem: Let TG* = (A, £*) be a transition graph. Find a 
feedback law u : A — ► [0, U] such that TG(u) = TG*. 

Clearly, £* cannot be arbitrary in A 2 , and must in particular contain only arrows 
of the form (a, a ± e^). Now in the present, restricted, context the equivalent 
linear programming problem described in [13] is very simple. For each a £ A, 
the control problem above requires that the focal point 4>(a, u(aj) belongs to a 
certain union of boxes, i.e. its coordinates must satisfy inequalities of the form 

Of {a) < «n(o)/(7Ko)«(o)+7?(o)) < ef {a \ or equivalents 

Kl ( a )-7°(a)flf (a) f) Ki (a)- 7 °(^r (a) (Q) 

7?(«)«T (a) 7?(«)^r (a) 

if 7* (a) > 0, and in reverse order otherwise. Hence, the solution set of the 
control problem is just the Cartesian product of all intervals of the form (J9j) , 
when a varies in A. It is thus identical to a rectangle in R# A (where # denotes 
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cardinality) , which is of full dimension if and only if the problem admits a so- 
lution. 

Thanks to the explicit description ([9]) , this set can be computed with a complex- 
ity which is linear in #A. The latter grows exponentially with the dimension of 
the system, but in practice, one will face problems where £ and £* only differ 
on a subset of initial vertices, say A*, and then the actual complexity will be of 
order 

In addition to this type of control, we introduce in this note some first hints 
toward dynamic feedback control, where instead of a direct feedback u, one uses 
some additional variable (here a single one), evolving in time according to a 
system of the form (JTJ) , and coupled to the initial system. This is suggested 
by the rectangular form of admissible inputs found in (J9j) : instead of fixing 
an arbitrary value in a rectangle of an external input space, one increases the 
state space dimension, which has the effect of adding new boxes to the system. 
The dynamics of the supplementary variables is then defined by analogy with 
the direct feedback case: when the initial variables are in a box a, this makes 
additional variables tend to a box of the form ([9j) . 

This raises a number of questions, in large part due to the fact that instead of 
applying an input u(a) instantaneously when entering box D a , the feedback now 
tends toward some value, which takes some time. Instead of fully developing a 
general theory, we thus have to chosen to illustrate it on a simple example, in 
section 15.11 

5 Examples 

We now illustrate with examples how it is possible to combine results of the two 
previous sections, and compute qualitative feedback laws ensuring (or preclud- 
ing) the existence and uniqueness of oscillatory behaviour of a system of the 
form Q. 

5.1 Example 1: disappearance of a limit cycle 

Consider the following two dimensional system: 



where x 2 has a unique threshold, and s ± (x 2 ) = s ± (x2, 9\). We assume moreover 
that the following inequalities stand: 



so that the first decay rate increases with u. Also, the interactions are func- 
tional: an activation of a variable leads to the corresponding focal point coordi- 
nate being above a variable's threshold (chosen as the highest one for xi, since 
otherwise 9\ cannot be crossed from below). Remark that in this system, x 2 
violates (HI). However, it will appear soon that this autoregulation is only 
effective at a single wall, which is unstable, and thus can be ignored safely. 
This system corresponds to a negative feedback loop, where X2 is moreover able 




± 2 {t) = K 2 [s+(x 1 ,0l)s+(x 2 ) + s + {x 1 ,9 2 1 )s-(x 2 )} -y%x 2 



(10) 



7l >o, Ki>7i°0i, k 2 > j°el, 



(ii) 
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to modulate its activation by X\: when X2 is above its threshold, the interaction 
is more efficient, since it is active at a lower threshold 9\ <9\. Biologically, this 
may happen if the proteins coded by x\ and X2 form a dimer, which activates X2 
more efficiently than x\ protein alone. This is reminiscent of the mixed feedback 
loop, a very widespread module able to display various behaviours [15] . It might 
be depicted by this graph 




As seen in the equations, the scalar input is assumed to affect the first decay 



rate, but not the second (i.e. 
points of all boxes: 



72 1 



0). Now, one readily computes the focal 



00 


01 


10 


11 


20 


21 


01 





01 





01 














02 


02 


02 



(12) 



where 0i is an abbreviation for K\ / (7fti + 7?) , and fa for K^j^. Under the 
constraints ifTTj) . this readily leads to the transition graph in absence of input 
(i.e. u = in all boxes): 



TG(0)= 01- 



\ I t 



The dotted line represents an unstable wall, for which Filippov theory would 
be required for full rigour. However, this wall is not reachable, and we ignore it 
afterwards. 

Now, since this graph has a cycle, the two thresholds 6^' 2 are crossed, and lfT2j) 
is easily seen to imply condition |(7|), conclusion B) of Theorem Q] applies : there 
is a unique stable limit cycle. 

Now, in accordance with the section's title, let us look for a u leading to: 



TG* 



Ul 

\ 



t 



Clearly from TG*, the box T> w attracts trajectories from all other boxes, and 
contains its own focal point, which is thus a globally asymptotically stable equi- 
librium. The only states whose successors differ in TG(0), and TG* are 10 and 
20, hence we assume u(a) = for all other a € A, or A* — {10, 20} to recall the 



notations of previous section. Then, Eq. ([9]) with 9\ 
gives: 

h' , • • - ['l-l- 

< u(a) < 



-(a) 



and 91 



(13) 



for both a G A*. This defines a nonempty interval by 9\ <0f, hence the Control 
Problem of previous section can be solve under constraints ifTTj) . An illustration 
on a numerical example is shown Figure [2j 



Now, let us focus on the question of realising an extended network which 
solves the same problem, by adding a variable to system (TT0|) . In other words, 



RR n° 7130 



12 



Farcot & Gouze 




Figure 2: Dashed lines: with feedback control. Plain lines: without. Two initial 
conditions, (0.95, 0.95) in box 21 (blue curves) and (0.85, 0.15) in 20 (red curves). 
The controlled and autonomous trajectories only diverge in box 10, 20 where 
the feedback is active. See parameters in ApDendix lA.il 



one now seeks to impose the dynamics described by TG* using dynamic feed- 
back. Biologically, this amounts to designing a genetic construct whose promoter 
depends transcriptionaly on x\ and X2, and increases the degradation rate of 
x\. Let us denote by y the expression level of this additional gene. The most 
obvious version of such an extended system arises by increasing y production 
rate exactly at boxes in A*: 



ii(t) = K 1 s-{x 2 ) - (i{vs + (y) +7?)zi 

XI (t) = K 2 [ S + (X U 6\)S+ (x 2 ) + S+ {xx , 0?)S- {X2)\ 

y(t) = s + (x 1 ,9\)s-(x 2 ) -J y y 



72^2 



(14) 



v a constant in the interval (fT3l) . so that forcing s + (y) = 1 would lead us back 
to a static feedback solution. This use of a single constant v is possible in this 
particular example because constraints (TL3|l are identical for the two boxes in 
A*, but it should be noted that in general several constants might be required. 
We consider without loss of generality that y £ [0, l/7 tf ], since higher values 
of y tend to l/7 a or 0. Also, s + (y) is defined with respect to a threshold 
y £ (0, 1). We also assume 9 y j v < 1, ensuring that y may cross its threshold 
when activated. 

Now, (fTl"]) defines an autonomous systems of the form |T]), whose transition 
graph has indeed a fixed point 101: 



011-< 



lll-<- 



■211 




(15) 



010 -< 
000 >-100 



210 
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This fixed point corresponds the fixed point 10 of TG*: in fact, the upper part of 
the graph above, where s + {y) = 1 is exactly TG*. However, it is not invariant, 
and some trajectories can escape to s + (y) = 0, where we see TG(0), and thus the 
possibility of periodic solutions. Besides, there are other cycles in this graph. 
Unlike static feedback control - and more realistically - the effect of y on 71 
takes some positive time, explaining why the situation is not a direct translation 
of previous case. We will now show that under additional constraints of the 
parameters governing y's dynamics, it is possible to guarantee that D101 contains 
a globally asymptotically stable equilibrium. To achieve this, let us rephrase a 
lemma, proved as Lemma 1 in |llj : 

Lemma 1. For any box, there is at most one pair of parallel walls successively 
crossed by solution trajectories of a system of the form $7]). 

In other words, there is at most one direction i such that opposite walls, of 
the form Xi — 0~ and Xi ~ Of , are crossed. Moreover, such an i is characterised, 
see [11], by the condition 

VjVi, n(9r) <r 3 (0j), (16) 

under the assumption I ou t = lf ut (which simplifies the description without loss 
of generality) , i.e. all exiting walls occur at higher threshold values, of the form 
Of , which is thus the threshold involved in the definition of n , Eq. ([5]) . This 
allows us to prove the following result: 

Proposition 1. Suppose that the parameters of [1$ satisfy, denoting <fi- - h ' • 



(l-lyO y )-<y > 



Then there the steady state in box Dioi attracts the whole state space of system 

G3P- 

Proof. Since each box is either containing an asymptotic steady state, or has all 
its trajectories escaping it toward a focal point, all limit set must be contained 
in a strongly connected component of the transition graph, i.e. a collection of 
cyclic paths sharing some vertices. A visual inspection of the transition graph 
displayed in (fT5l) shows that any cyclic path in the transition graph TG must visit 
the state 100. This state has only two successors: 200 and 101, the fixed state. 
Hence it has two exit walls, which we denote by: Wf — {0\} x (8%, Q\) x (0, y ) 
and W+ = (#1,0?) x (#2^2) x {8y}> All other walls are incoming. Denoting 
them by obvious analogy with the two exiting walls, let us consider each of them. 
First, both walls Wf are repelling: this has already been said for Wf when 
discussing auto- regulatory terms in iflOl) . For W 2 ~ , this follows from the fact that 
D100 contains only trajectories escaping in finite time, and can be extended 
to this wall by continuity. Moreover, it follows from TG that any trajectory 
escaping W% either reaches D101 (where the fixed point lies), or enters D100 
again via the wall W-f. Thus, any trajectory which does not enter D 101 must 
cross the pair Wf in succession. Now, from Lemma [TJ among the two pairs of 
walls Wf , W±, only one can be crossed in succession by trajectories. Moreover, 
the inequality in the statement is the exact translation of the condition (jTHJ) , 
in the case where Wf is the crossed pair of walls, precluding any attractor but 
the known fixed point, 0(101). □ 
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Figure 3: Dashed line: inequality of proposition [TJ satisfied. Plain line: inequal- 
ity violated. Two common initial conditions, (xi,X2,y) — (0.95; 0.95, 0.1) (blue) 
and (0.95,0.95,0.95) (red). The value of y has been divided by 10 to keep all 
variables in [0,1]. In both cases a limit cycle is controlled into an equilibrium 
point. See parameters in Appendix IA. 21 

Some elementary calculus shows that the left-hand side in the inequality of 
proposition [TJ is a increasing function of 7 a when 7 y € (0, l/0 y ), as assumed 
previously. Thus, this inequality is equivalent to requiring a lower bound to j y , 
eventhough this bound does not have a simple explicit form. 
This fact can be given an intuitive explanation: ■jy is inversely proportional 
to the characteristic time of the variable y, in each box. Hence, proposition [TJ 
means that the dynamics of y must be fast enough in order to retrieve the 
behaviour of the static feedback control, which corresponds to the limit of an 
instantaneous feedback. See Figure [3] for a numerical example. 

The results of this section can be summarised as 

Proposition 2. A system of the form U0\) . with structural constraints {HP, 
has a unique, stable and globally attractive limit cycle in absence of input, i.e. 
u = 0. 

There exists a control law ensuring a unique, stable and globally attractive equi- 
librium point. This control can be achieved in two ways: 

•) Using a scalar piecewise constant feedback u, such that u{a) satisfies i t iff)) 
for a e {10,20}. 

•) Using dynamic feedback with a single additional variable y, as in 
whose decay rate satisfies the condition in proposition^ and with v a solution 

of m- 
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5.2 Example 2 : birth of a limit cycle 

Let us now consider the following system 

±i(t) = K x s+{x 2 ) - (7^ + 7°) xi 
x 2 (t) = K\ s~(x 3 ) + K\ s-(x u 6l) - ( 7 i« + 7 °) x 2 
i 3 (*) = K 3 s+(xi,0{) - (jiu + 7 3 °) x 3 



(17) 



where s + (a;.;) abbreviates s + (xi,9\) for i = 2,3, We assume the following con- 
straints to be satisfied 



7 i>0, 1 = 1,2,3, K x >0?7i° >e\ 1 ° 1 
K 3 >6 3l l K i 2 >6 2l ° 2 , i=l,3. 



(18) 



This system is a particular case of two combined negative feedback loops, of the 
form: 



® 



Since the behaviour of a single loop is well characterised by theorem it can 
be considered as one of the simplest systems whose behaviour might be worth 
investigating. 

Computing the focal points of all boxes, with the abbreviations fa = Ki/(jfu + 
7°) (with additional superscripts to fa and Ki for i = 2) and fat = fa] + fa], 
leads to the following table: 



000 


100 


200 


010 


110 


210 


001 


101 


201 


011 


111 


211 











fa 


fa 


fa 











fa 


fa 


01 


<j>+ 


<t>i 


$ 








fa) 


<t>l 





fa] 


<t>\ 








fa 


fa 





fa 


fa 





fa 


fa 





fa 


fa 



Under the indicated parameter constraints, the following transition graph is 
easily deduced: 



TG(0)= 011 . 
7f 



■>-lll >-211 



(19) 



001 -<r-\ 101 ■< 

I y 1 I 

oio — ->-uo — - 

V \* I. 

000 -< 100 -< 200 



't 

■210 



The region with bold arrows - i.e. the whole graph in this case - is invariant, 
and we see that depending on the parameter values, the actual solutions of ifTTj) 
may have various behaviours: to each periodic path in TG(0), a stable periodic 
orbit may possibly correspond, and there is an infinity of such paths. Some 
examples have already been provided of such situations, where periodic paths 
of arbitrary length can be realised as stable limit cycles, by suitable choice of 
parameters [17]. Although it does not present a fixed box, it may also have a 
stable equilibrium, limit of damped oscillations, as will be illustrated soon. 
In order to guarantee that the system oscillates, we fix the following objective: 



TG* 



011 ^lll-e 211 



(20) 
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We now see that the invariant region in bold is a cycle with no escaping edge. 
Furthermore, it lies in the region where s~(xi, 9f) = 1, and it appears from ifTTj) 
that the system in this region is a negative feedback loop involving the three vari- 
ables. Hence, from theorem [21 we can conclude that there exists a unique stable 
limit cycle, which is globally attractive, as deduced from TG*. Yet, it remains 
to state the inequalities defining this graph. They follow from the inversion of 
arrows in contact with some a G A* = {110,210,111,211,001, 101,011}, which 
leads to 



for a G A*. The problem is thus reduced to the satisfiability of the inequality 
between the two extreme terms above. This fact holds for some parameter values 
satisfying constraints ifTS]) . and the results of this section can be summarised as 

Proposition 3. A system of the form if 17\) . with structural constraints H8\) . 
may present a large variety of asymptotic behaviours without input, i.e. when 
u = 0. This includes steady states, as shown Figures^ and [5] , as well as limit 
cycles (not shown). 

If u is a scalar piecewise constant feedback, such that u{a) satisfies ^21\) for 
a G A* , and u(a) — elsewhere, then there exists a unique, stable and globally 
attractive limit cycle. 

6 Conclusion 

We have given, and illustrated by two examples, a control methodology to make 
unique stable limit cycles appear or disappear in hybrid PWA systems. The ob- 
tained feedback laws are termed qualitative control because they depend only 
on a qualitative abstraction of the original system; its transition graph. 
Future work suggested by this study are mostly related to the question of dy- 
namic feedback. Actually, the first example shows the effective possibility of 
using an additional variable to control a system, i.e. to design a controller sys- 
tem to be coupled to the original one. Moreover, the design of this dynamic 
feedback relied in a simple way on the static feedback problem. This technique 
should be formalised in more general terms, and applied to other examples in 
the future. 
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This system, following |(9]), can be reduced to: 




(21) 
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■l 



Figure 4: Blue, dashed line: without feedback control, spirals towards a fixed 
points. Red, plain line: with control, tends to a limit cycle. Common initial 
condition 2:2, 2:3) = (0.95,0.95,0.1). See parameters in Appendix IA. 31 




5 10 IS 20 25 




D 5 10 IS 20 a 



Figure 5: Same curves as Figure [H vs time. The blue curve stops before the 
red one for the following reason. The numerical solutions are computed using 
the transition map, from wall to wall, and the uncontrolled trajectory crosses 
successive thresholds within time intervals tending to zero. 
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A Parameter values 
A.l Parameters for Figure [2] 
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Moreover the value u(a) is computed as the middle-point of the interval defined 
by (531). 

A. 2 Parameters for Figure [3] 
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To check the inequality in proposition [IJ we need to compute ( ^rrp J 71 = 

0.375. Then, the two values of "f y we have tested are 0.1 and 1.7, for which 

i 

(1 — 7 y 0y)~ ry is respectively close to 0.599 (inequality satisfied) and 0.328 (in- 
equality violated). 

A. 3 Parameters for Figures [4] and [5] 
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where i stands for all values in {1, 2, 3} For these values, inequality (|2Tj) writes, 
term by term: 

max{0.2,0.2} < u(a) < min{l, 0.8, 0.5} 
and we have chosen u(a) = 0.3 in the simulations. 
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